To delete a category with all its variables, use the following code:
frxReport1.Variables.DeleteCategory('My Category 1');